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METHOD AND SYSTEM FOR DIRECT LINKAGE OF A RELATIONAL 
DATABASE TABLE FOR DATA PREPARATION 

BACKGROUND OF THE INVENTION 

5 

1. Technical Field: 

The present invention relates generally to an 
improved data processing system and, in particular, to a 
method and system for improving a relational database 
10 system. Still more particularly, the present invention 

relates to a method, apparatus, and computer instructions 
for direct linkage of relational database tables and 
other files for data preparation. 

15 2. Description of Related Art: 

In order to perform analysis on data currently 
existing in a relational database, system analysts 
utilize various data preparation tools in order to 
prepare data for utilization. For example, to "prepare" 

20 data for utilization, system analysts might clean, 

transform, and consolidate data into a format that is 
most suitable for analysis. These steps are examples of 
steps used to "prepare" the data for analysis. An 
example of a data preparation tool is SAS, available from 

25 SAS Institute, Inc. SAS Institute offers a set of 
enterprise software that allows system analysts to 
perform business functions, such as data warehousing, 
data mining, human resources management, financial 
management, and decision support, etc. SAS offerings 

3 0 include Base SAS and SAS/ACCESS software. Base SAS 

provides a SAS language, procedures and a macro facility 
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for data analysis and reporting. SAS/ACCESS software 
provides an interface between Base SAS and various types 
of relational databases from different vendors, so that 
different relational database data may be accessed. One 
5 type of relational database includes DB2 , a product 
available from International Business Machines 
Corporation. 

In order to analyze data in SAS, input data has to 
be in SAS dataset format. A SAS dataset includes data 

10 values of a data object and variables that define 

characteristics of the data object. For example, 'Name 7 
is a variable having data values of 'David' or 'John' . 
Currently, SAS includes functionality to load data from 
an existing SAS dataset into a relational database table 

15 by using a DATA step and a PROC step. The DATA step 
takes raw input data, for example, a SAS dataset, and 
computes values or applies conditional logic to the 
dataset to generate an output, such as a report. The 
PROC step takes a SAS dataset as an input, calls a group 

2 0 of SAS statements, and executes a procedure to analyze 

data in order to generate a report. The PROC step 
includes a DBLOAD function that creates a new relational 
database table and loads a SAS dataset into the newly 
created table. 

25 The above functionality moves data only in one 

direction, that is, SAS can load a SAS dataset into a 
database table. If a user wants to move data in the 
other direction, that is, load database table data into a 
SAS dataset, then some other process must be used to take 

3 0 input data from a database table and create an SAS 

dataset for data preparation. A common process is for 
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the user to manually write database table data into a 
flat file and write SAS code to read the file into a SAS 
dataset . This process requires a user to perform 
multiple steps including writing data to and reading data 
5 from an output flat file. These steps increase the time 
and effort needed to analyze data. 

Therefore, it would be advantageous to have an 
improved method, apparatus, and computer instructions to 
directly link relational database table (s) and SAS 
10 dataset (s) in a simplified solution that moves data in 
both directions without the need to perform multiple 
steps to read and write data to an output flat file. 
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SUMMARY OF THE INVENTION 

The present invention provides a method, apparatus, 
and computer instructions for direct linkage of 
5 relational database table to a data preparation tool for 
data preparation. In a preferred embodiment, the 
mechanism of the present invention allows data to be read 
directly from one or more relational database tables to a 
data preparation tool into datasets without generating 

10 output flat files as an intermediate step. Multiple 

datasets from different relational database tables are 
merged into one dataset if more than one relational 
database table is read. Upon completion of necessary- 
data preparation on the dataset by the data preparation 

15 tool, the present invention creates a new relational 

database table and loads resulting data from the prepared 
dataset into the new relational database table. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The 
5 invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, wherein: 
10 Figure 1 is a pictorial representation of a network 

of data processing systems in which the present invention 
may be implemented; 

Figure 2 is a block diagram of a data processing 
system that may be implemented as a server in accordance 
15 with a preferred embodiment of the present invention; 

Figure 3 is a block diagram illustrating a data 
processing system in which the present invention may be 
implemented ; 

Figure 4 is a diagram illustrating components for 

2 0 direct linkage of a relational database table to data 

preparation tool for data preparation in accordance with 
a preferred embodiment of the present invention; 

Figure 5 is a diagram of database tables, datasets, 
and a SAS procedure used for direct linkage of relational 
25 database table for data preparation in accordance with a 
preferred embodiment of the present invention; 

Figure 6 is an example of a program used for the 
direct linkage of relational database table for data 
preparation in accordance with a preferred embodiment of 

3 0 the present invention; and 



6 

Docket No. RSW920030075US1 



Express Mail No. EV162980305US 



Figure 7 is a flowchart illustrating the exemplary 
process for direct linkage of a relational database table 
for data preparation in accordance with a preferred 
embodiment of the present invention. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to the figures, Figure 1 depicts a 
pictorial representation of a network of data processing 
5 systems in which the present invention may be implemented. 
Network data processing system 100 is a network of 
computers in which the present invention may be 
implemented. Network data processing system 100 contains 
a network 102, which is the medium used to provide 

10 communication links between various devices and computers 
connected together within network data processing system 
100. Network 102 may include connections, such as wire, 
wireless communication links, or fiber optic cables. 

In the depicted example, server 104 is connected to 

15 network 102 along with storage unit 106. In addition, 
clients 108, 110, and 112 are connected to network 102. 
These clients 108, 110, and 112 may be, for example, 
personal computers or network computers. In the depicted 
example, server 104 provides data, such as boot files, 

20 operating system images, and applications to clients 108- 
112. Clients 108, 110, and 112 are clients to server 104. 
Network data processing system 100 may include additional 
servers, clients, and other devices not shown. 

In the depicted example, network data processing 

25 system 100 is the Internet with network 102 representing a 
worldwide collection of networks and gateways that use the 
Transmission Control Protocol/Internet Protocol (TCP/IP) 
suite of protocols to communicate with one another. At 
the heart of the Internet is a backbone of high-speed data 

30 communication lines between major nodes or host computers, 
consisting of thousands of commercial, government, 
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educational and other computer systems that route data and 
messages. Of course, network data processing system 100 
also may be implemented as a number of different types of 
networks, such as for example, an intranet, a local area 
5 network (LAN) , or a wide area network (WAN) . Figure 1 is 
intended as an example, and not as an architectural 
limitation for the present invention. 

Referring to Figure 2, a block diagram of a data 
processing system that may be implemented as a server, 

10 such as server 104 in Figure 1, is depicted in accordance 
with a preferred embodiment of the present invention. 
Data processing system 200 may be a symmetric 
multiprocessor (SMP) system including a plurality of 
processors 202 and 204 connected to system bus 206. 

15 Alternatively, a single processor system may be employed. 
Also connected to system bus 206 is memory 
controller/cache 208, which provides an interface to local 
memory 209. I/O bus bridge 210 is connected to system bus 
206 and provides an interface to I/O bus 212. Memory 

20 controller/cache 208 and I/O bus bridge 210 may be 
integrated as depicted. 

Peripheral component interconnect (PCI) bus bridge 
214 connected to I/O bus 212 provides an interface to PCI 
local bus 216. A number of modems may be connected to PCI 

25 local bus 216. Typical PCI bus implementations will 
support four PCI expansion slots or add- in connectors. 
Communication links to clients 108-112 in Figure 1 may be 
provided through modem 218 and network adapter 220 
connected to PCI local bus 216 through add-in boards. 

3 0 Additional PCI bus bridges 222 and 224 provide 

interfaces for additional PCI local buses 226 and 228, 
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from which additional modems or network adapters may be 
supported. In this manner, data processing system 200 
allows connections to multiple network computers. A 
memory-mapped graphics adapter 230 and hard disk 232 may 
5 also be connected to I/O bus 212 as depicted, either 
directly or indirectly. 

Those of ordinary skill in the art will appreciate 
that the hardware depicted in Figure 2 may vary. For 
example, other peripheral devices, such as optical disk 
10 drives and the like, also may be used in addition to or in 
place of the hardware depicted. The depicted example is 
not meant to imply architectural limitations with respect 
to the present invention. 

The data processing system depicted in Figure 2 may 
15 be, for example, an IBM eServer pSeries system, a product 
of International Business Machines Corporation in Armonk, 
New York, running the Advanced Interactive Executive 
(AIX) operating system or LINUX operating system. 

With reference now to Figure 3, a block diagram 

2 0 illustrating a data processing system is depicted in which 

the present invention may be implemented. Data processing 
system 300 is an example of a client computer. Data 
processing system 300 employs a peripheral component 
interconnect (PCI) local bus architecture. Although the 
25 depicted example employs a PCI bus, other bus 

architectures such as Accelerated Graphics Port (AGP) and 
Industry Standard Architecture (ISA) may be used. 
Processor 302 and main memory 304 are connected to PCI 
local bus 306 through PCI bridge 308. PCI bridge 308 also 

3 0 may include an integrated memory controller and cache 

memory for processor 302. Additional connections to PCI 
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local bus 306 may be made through direct component 
interconnection or through add-in boards. In the depicted 
example, local area network (LAN) adapter 310, SCSI host 
bus adapter 312, and expansion bus interface 314 are 
5 connected to PCI local bus 306 by direct component 

connection. In contrast, audio adapter 316, graphics 
adapter 318, and audio/video adapter 319 are connected to 
PCI local bus 306 by add- in boards inserted into expansion 
slots. Expansion bus interface 314 provides a connection 

10 for a keyboard and mouse adapter 320, modem 322, and 

additional memory 324. Small computer system interface 
(SCSI) host bus adapter 312 provides a connection for hard 
disk drive 326, tape drive 328, and CD-ROM drive 330. 
Typical PCI local bus implementations will support three 

15 or four PCI expansion slots or add-in connectors. 

An operating system runs on processor 302 and is used 
to coordinate and provide control of various components 
within data processing system 300 in Figure 3. The 
operating system may be a commercially available operating 

20 system, such as Windows XP, which is available from 

Microsoft Corporation. An object oriented programming 
system such as Java may run in conjunction with the 
operating system and provide calls to the operating system 
from Java programs or applications executing on data 

25 processing system 300. "Java" is a trademark of Sun 

Microsystems, Inc. Instructions for the operating system, 
the object-oriented operating system, and applications or 
programs are located on storage devices, such as hard disk 
drive 326, and may be loaded into main memory 304 for 

30 execution by processor 302. 
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Those of ordinary skill in the art will appreciate 
that the hardware in Figure 3 may vary depending on the 
implementation. Other internal hardware or peripheral 
devices, such as flash read-only memory (ROM) , equivalent 
5 nonvolatile memory, or optical disk drives and the like, 
may be used in addition to or in place of the hardware 
depicted in Figure 3. Also, the processes of the present 
invention may be applied to a multiprocessor data 
processing system. 

10 The depicted example in Figure 3 and above -described 

examples are not meant to imply architectural 
limitations. For example, data processing system 300 
also may be a notebook computer or hand held computer in 
addition to taking the form of a PDA. Data processing 

15 system 300 also may be a kiosk or a Web appliance. 

The present invention provides a method, apparatus, 
and computer instructions for direct linkage of a 
relational database table to a data preparation tool for 
data preparation to place data into a form for analysis 

20 in the relational database. In a preferred embodiment, 
the mechanism of the present invention provides a direct 
linkage of a relational database table to a data 
preparation tool in order to read raw input data from a 
database table into a dataset, such as SAS dataset, 

25 without the need of generating an output flat file. 

The mechanism of the present invention includes a 
single set of SAS procedure statements that reads raw 
input data by creating a temporary dataset and selecting 
data from the input database table. Specifically, the 

3 0 SAS procedure PROC SQL is used as the framework to set up 
the SQL commands to connect to a relational database, 
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create a temporary SAS dataset, select the desired 
columns from the source database table, and disconnect 
from the database. For example, select 
tablename . columnnamel , tablename . columnname 2 from 
5 tablename. In this example, tablename is the name of the 
database table and columnnamel and columnname 2 are names 
of the desired columns from tablename table. 

If more than one database table is required, the 
mechanism of the present invention allows additional 

10 temporary datasets to be created and loaded with data 
from other database tables. Each database table has a 
corresponding temporary dataset . 

In the illustrative example, once all of the 
selected data is read from database tables, the temporary 

15 datasets are merged into a single merged dataset. A user 
may perform additional data preparation. For example, 
adding values from one column of a database table to 
values of another column of the same database table. 
Data preparation may be performed either before or after 

2 0 merging datasets in order to produce the desired output 

data in these illustrative examples. 

After the desired output dataset has been prepared, 
the mechanism of the present invention creates a new 
database table with the table name specified by the user 
25 and writes output data from the resulting dataset into 
the new database table. The new database table may 
reside in the same database or in a different type of 
database, as long as the database type is compatible with 
the data preparation tool. 

3 0 Turning now to Figure 4, a diagram illustrating 

components for direct linkage of a relational database 
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table to a data preparation tool for data preparation is 
depicted in accordance with a preferred embodiment of the 
present invention. As depicted in Figure 4, in this 
example implementation, database DB(1) 402 resides on 
5 server 404. Server 404 may be implemented as server, 
such as server 104 in Figure 1. In the illustrative 
example, database DB(1) 402 includes table 1 406, though 
more than one table may be used. 

The mechanism of the present invention may be 

10 implemented on a data processing system, such as client 
408. Client 408 may be implemented as a data processing 
system, such as data processing system 200 in Figure 2. 
In this example, a user executes a data preparation tool, 
such as Base SAS 410, on client 408 to analyze data. 

15 Base SAS 410, a product available from SAS Institute 

Inc., reads and transforms the input data and generates 
the desired output data for the user. 

In order to retrieve data from a relational database 
table, the user uses an interface, such as SAS /ACCESS 

2 0 software, to read the data directly from the database 

table. SAS /ACCESS software, a product available from SAS 
Institute Inc., provides methods for accessing data from 
various types of databases made by different vendors. 
Different types of databases include, for example, DB2 , a 
25 product available from International Business Machine 

Corporation, and Oracle, a product available from Oracle 
Corporation. 

For each type of database, represented by database 
DB(1) 402, a ' corresponding SAS/ACCESS software is used to 

3 0 access data from a database table. In this example, 

SAS/ACCESS software for DB(1) 412 is used to access data 
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from table 1 406. In this case, database DB(1) is a DB2 
database- Thus, for a different type of database, 
represented by database DB(2) 414 running on server 416, 
a corresponding SAS/ACCESS software for DB(2) 418 is used 
5 to access data. For purposes of this illustration, 
database DB(2) 414 is an Oracle database. 

In one illustrative embodiment of the present 
invention, a user may desire to analyze data in DB(1) 
402. In order to analyze data, a temporary dataset is 

10 created in Base SAS 410 and data is read from table 1 406 
of DB(1) 402. The data is read from table 1 406 by 
executing a SAS procedure SQL statement to connect to 
DB(1) 402 and selecting all the data from table 1 406. 
The SAS procedure SQL statement is part of the SAS/ACCESS 

15 software for DB(1) 412. If data from more than one table 
is needed, such as table 3 422, an additional dataset is 
created and loaded with data from table 3 422. The above 
mechanism also requires a user to have a valid access 
right, such as a read access, to DB(1) 402 and a valid 

2 0 license to run Base SAS 410 and SAS/ACCESS software for 

DB(1) 412. 

Once all necessary data is read from table 1 406 and 
table 3 422, Base SAS 410 merges both datasets into a 
single dataset and performs data preparation either 
25 before or after merging if necessary. One example of 

data preparation is adding one data value to another data 
value of the dataset. After data preparation is 
complete, the mechanism of the present invention executes 
a module that creates a hew database table, such as table 

3 0 2 424, in DB(1) 402 and loads data from the resulting 
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dataset into table 2 424 through the use of SAS/ACCESS 
software for DB(1) 412. 

In another illustrative embodiment of the present 
invention, instead of creating a new database table in 
5 DB(1) 402, a user may want to send the resulting output 
data to another type of database, DB(2) 414. In this 
case, the mechanism of the present invention executes a 
module to create a new database table, such as table 4 
420 in DB(2) and loads data from the resulting dataset 

10 into table 4 420 through the use of SAS/ACCESS software 
for DB(2) 418. 

Turning next to Figure 5, a diagram of example 
database tables, datasets, and a SAS procedure used for 
direct linkage of a relational database table for data 

15 preparation is depicted in accordance with a preferred 
embodiment of the present invention. As depicted in 
Figure 5, customer table 502 includes table column name 
504, amount 506, unit 503 and state 510. Each column 
includes data values associated with a customer. For 

20 example, an amount of 13.00, a unit of 1, and state X CA' 
are associated with customer x Tom Smith' . 

Currently, the prior art approach to link data from 
a database table to a SAS data preparation tool involves 
the intermediate step of generating an output flat file 

25 that is, in turn, read in by SAS to create a SAS dataset. 
In this example, output flat file 1 512, is generated 
containing the data from customer table 502. A user 
writes code to read the data from customer table 502 and 
write the data to the output flat file 1 512. In this 

30 example, if data from another database is required for 

data analysis, another output flat file is generated and 
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parsed by SAS to create another SAS dataset . Output flat 
file 2 52 0 is generated with data from shipping table 
514, which includes column state 516 and ship cost 518. 
The generating of output flat files introduces extra 
5 steps that the user must perform in order to load data 
from the database tables. 

In contrast, using the mechanism of the present 
invention, output flat files are not a necessary 
intermediate step to create SAS datasets. Data from 

10 database table, such as customer table 502, is read and 
dataset, such as SAS dataset customer 522, is created by 
a single set of SAS procedure statements according to an 
illustrative embodiment of the present invention. The 
extra steps are eliminated because the user is not 

15 required to write code to read and write the output flat 
files . 

In addition to data values from customer table 502, 
SAS dataset customer 522 includes data descriptors that 
define characteristics of data values. For example, 

2 0 variable 524 defines names of data values, such as 

customer, name, amount, etc.; type 526 defines type of 
data values, such as number, character, date etc.; length 
528 defines lengths of data values, such as 5 digit 
number or 7 characters, etc.; and pos 530 defines 

25 positions of data values in the dataset, such as position 
0 for customer, position 5 for name, etc. 

In this example, since data from shipping table 514 
is also required, this data is read and SAS dataset 
shipping 532 is created by a single set of SAS procedure 

30 statements. SAS dataset shipping 532 is similar to SAS 
dataset 522, which includes data values and data 
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descriptors. Once all data values are read from the 
database tables, customer table 502 and shipping table 
514, SAS dataset customer 522 and shipping 532 are 
created from these tables. Then, both datasets are 
5 merged into a single dataset, merged dataset final 534. 

Merged dataset final 534 includes data values from 
SAS dataset customer 522 and SAS dataset shipping 532. If 
data preparation is needed, SAS procedure 534 that 
prepares data from merged dataset final 536 is run to 
10 produce the desired output data. An example of data 

preparation includes calculating a total by multiplying 
the amount and the unit value and adding the result to 
ship cost . 

Thus, the mechanism of the present invention allows 
15 for the direct linkage of one or more database tables, as 
well as the use of a data preparation tool, to create one 
or more datasets using data from database tables, without 
the use of output flat files and code written by the 
user . 

2 0 Turning next to Figure 6, a diagram of an example 

program used for the direct linkage of a relational 
database table for data preparation is depicted in 
accordance with a preferred embodiment of the present 
invention. As depicted in Figure 6, program 602 includes 

25 section 604, section 606 and section 608. Section 604 
includes a SAS procedure statement, PROC SQL statement 
610, to connect to a database, DB2 612. Once the database 
is connected, a new temporary dataset Temp.x 614 is 
created with existing data from table 1 by selecting data 

30 from table 1 as shown in line 616. Table 1 includes data 
for columns such as name, amount, unit and State. Once 
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the data is selected, connection to the database is 
disconnected in line 618. If data from other database 
table is required, the above PROC SQL statements are 
repeated for each additional database table to create 
5 additional temporary dataset. Once all the data is read 
from the database tables into one or more temporary 
datasets, the datasets are merged into a single dataset. 

Next, in section 606 of program 602, the merged 
dataset is used for data preparation. The dataset name 

10 'output' may be specified by the user using a data 

procedure statement, such as 'data output' in line 620. 
Next, data from temporary dataset x in line 622 is 
prepared by applying conditional logic in line 624. For 
example, if the value of 'unit' is greater than 0, 

15 variable 'total' of the dataset is equal to the value of 
'unit' multiplied by the value of 'amount' . Otherwise, 
the value of 'total' is equal to 0. 

Once the dataset named 'output' is prepared, section 
608 includes procedure statements for defining a macro in 

20 section 626. For example, macro DB2CRT is defined with 
'dataname' 4 as an input parameter. In this example, 
'dataname' represents the name of the dataset as well as 
the new database table name that will be created by 
running this macro. A PROC DBLOAD statement then creates 

2 5 a new database table and loads data from the input 

dataset into the new database table. Finally, macro 
DB2CRT is executed in line 62 8 with an input parameter, 
such as 'output', and the new database table named 
'output' is created and loaded with data from dataset 

3 0 'output' . 
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Turning next to Figure 7, a flowchart illustrating 
exemplary process for direct linkage of a relational 
database table for data preparation is depicted in 
accordance with a preferred embodiment of the present 
5 invention. As depicted in Figure 7, from the data 

preparation tool's perspective, the process begins when 
the user wants to analyze data from a relational database 
table (step 702). Next, data from the database table is 
read (step 704) through an interface, such as SAS /ACCESS 

10 software, and a temporary dataset is created from data of 
the database table (step 706) . 

A determination is then made as to whether 
additional database tables are present for reading (step 
708) . If additional database tables are present for 

15 reading, the process returns to step 704 to read another 
database table and create another temporary dataset (step 
706) . If no additional database tables are present for 
reading, dataset s are merged into a single dataset (step 
710) . 

2 0 A determination is then made as to whether data 

preparation is required to produce the desired output 
data (step 712) . This determination is made through an 
indication provided by the user when data preparation 
section, such as section 606 of program 602 in Figure 6, 
25 is added to the program. If necessary, data preparation 
is then performed (step 714) . If the user does not want 
to prepare data, the user may delete the data preparation 
section of the program. Next, a new relational database 
table is created (step 716) . This new database is 

3 0 created regardless of whether data preparation was 

performed in the previous step. Finally, data from the 
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resulting single or prepared dataset is written to the 
newly created database table (step 718) with the process 
terminating thereafter. 

Thus, the present invention provides a direct 
5 linkage of relational database table to a data 

preparation tool for data preparation. A single-step 
x two-way' solution is provided by a single set of 
procedure statements that reads data from a database 
table into a dataset without the need of generating an 

10 output flat file. 

The number of steps involved in accessing data from 
a relational database table to a data preparation tool is 
minimized using the mechanism of the present invention 
because the user is not required to write code to read 

15 and write output flat files. In the case of using data 
from multiple database tables, the mechanism of the 
present invention saves the user the significant time and 
effort required to move data from the database table to 
the data preparation tool. Furthermore, the mechanism of 

2 0 the present invention allows data from different types of 
databases to be linked directly through the use of 
SAS/ACCESS software interface. 

It is important to note that while the present 
invention has been described in the context of a fully 

25 functioning data processing system, those of ordinary 
skill in the art will appreciate that the processes of 
the present invention are capable of being distributed in 
the form of a computer readable medium of instructions 
and a variety of forms and that the present invention 

30 applies equally regardless of the particular type of 
signal bearing media actually used to carry out the 
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distribution. Examples of computer readable media 
include recordable-type media, such as a floppy disk, a 
hard disk drive, a RAM, CD-ROMs, DVD-ROMs, and 
transmission- type media, such as digital and analog 
5 communications links, wired or wireless communications 
links using transmission forms, such as, for example, 
radio frequency and light wave transmissions. The 
computer readable media may take the form of coded 
formats that are decoded for actual use in a particular 

10 data processing system. 

The description of the present invention has been 
presented for purposes of illustration and description, 
and is not intended to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 

15 variations will be apparent to those of ordinary skill in 
the art . The embodiment was chosen and described in 
order to best explain the principles of the invention, 
the practical application, and to enable others of 
ordinary skill in the art to understand the invention for 

20 various embodiments with various modifications as are 
suited to the particular use contemplated. 



